Gog and Magog triangles, and the Schiitzenberger involution 

Hayat Cheballah and Philippe Biane 

Abstract. We describe an approach to finding a bijection between Alternat- 
ing Sign Matrices and Totally Symmetric Self-Complementary Plane Parti- 
tions, which is based on the Schiitzenberger involution. In particular we give 
an explicit bijection between Gog and Magog trapezoids with two diagonals. 

1. Introduction 

1.1. Alternating Sign Matrices. An alternating sign matrix (ASM) is a 
square matrix with entries in { — 1,0, +1} such that, on each line and on each 
column, the non zero entries alternate in sign, the sum of each line and each column 
being equal to 1. The number of such matrices of size n is 

(1.1) A n = n ^ 1 ^ = 1,2,7,42,429,... 

Zeilberger [9], Kuperberg [6]. The full story is in pQ. 

It has been known for a long time that the numbers A n also count the number 
of Totally Symmetric Self-Complementary Plane Partitions (TSSCPP), however no 
explicit bijection between these classes of objects has been constructed, and finding 
one is a major open problem in combinatorics. 

In this paper we propose an approach to this question which is based on the 
Schiitzenberger involution. More precisely, we consider Gog and Magog triangles 
(in the terminology of D. Zeilberger), which are triangular arrays of positive in- 
tegers, satisfying some growth conditions, in simple bijection with, respectively, 
ASMs and TSSCPPs. The basic idea underlying our approach is that these trian- 
gles are examples of Gelfand-Tsetlin patterns to which one can apply some known 
transformations, such as the Schiitzenberger involution. In fact we conjecture the 
existence of a bijection between Gog and Magog triangles which can be obtained 
in two steps, first by making a "modification" of a Gog triangle, based on its in- 
version pattern, then by applying the Schiitzenberger involution. This bijection 
should also preserve trapezoids, which are particular classes of triangles. As a first 
step towards a full bijection we construct here a bijection between (n, 2) Gog and 
Magog trapezoids (the terminology is explained below). 

The paper is organized as follows. 

In section 2 we introduce the definitions of Gelfand-Tsetlin triangles, the Gog 
and Magog triangles and trapezoids, and the Schiitzenberger involution. Then, in 
section 3, we formulate a conjecture on the existence of a bijection between Gog 
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and Magog triangles preserving trapezoids. Finally in the last section we give a 
bijection between (n, 2) Gog and Magog trapezoids. 

2. Gog and Magog triangles and trapezoids 

2.1. Gelfand-Tsetlin. 

Definition 1. A Gelfand-Tsetlin triangle of size n is a triangular array X — 
(xi.j)n^i^j^i of positive integers 

^n,l %n,2 ■ • ■ 2-n,n— 1 £n,n 

^n— 1,1 1.2 • ■ • 3?n— l,n — 1 



£2,1 2 2 ,2 

such that, whenever the numbers below are defined, 

■Ei+lJ ^ ^i.j ^ £'i+l,j + l- 

Iii other words, the triangle is made of n diagonals in the Northwest-Southeast 
(NW-SE) direction, of lengths n, n — 1, . . . , 2, 1 (from left to right), and it is weakly 
increasing in the SE and in the NE directions. 

Thus 

1 2 2 3 6 

12 2 5 
2 2 4 

2 4 
3 

is a Gelfand-Tsetlin triangle of size 5. 

Gog and Magog triangles will be obtained from Gelfand-Tsetlin triangles by 
imposing further conditions on the entries. 

2.2. Gog. 

2.2.1. Triangles. 

Definition 2. A Gog triangle of size n is a Gelfand-Tsetlin triangle such that 

(i) Xi.j < Xij+i, j<i^n-l 

in other words, such that its rows are strictly increasing, and such that 

(ii) x nJ =j, 1 < j < n. 

Here is an example with n = 5 

1 2 3 4 5 

13 4 5 
1 4 5 

2 4 
3 

There is a simple bijection between Gog triangles and Alternating sign matrices 
(see e.g. PQ). If (Mij)i^ij^ n is an ASM of size n, then the matrix My = 53fe=i ^ij 
has exactly i — 1 entries and n — i + 1 entries 1 on row i. Let (sy ) J= i,...,i be the 
columns (in increasing order) with a 1 entry of M on row n — i + 1. The triangle 
X = (xij) n ^i^j^i is the Gog triangle corresponding to M. 
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For example, the above Gog triangle corresponds to the following alternating 
sign matrix 
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2.2.2. Trapezoids. 

Definition 3. A (n, k) Gog trapezoid (for k < n) is a Gog triangle of size n, 
X = (xij)n^i^j^i such that Xij — j for i — j > k. 

Below is a (5, 2) Gog trapezoid. 

1 2 3 4 5 
12 4 5 
1 3 4 
1 3 
2 

See d], [a]. 

2.3. Magog. 

2.3.1. Triangles. 

Definition 4. A Magog triangle of size n is a Gelfand-Tsetlin triangle such that 

^ i, 1 ^ i ^ n. 

The set of Magog triangles of size n is in simple bijection with the set of Totally 
Symmetric Self Complementary Plane Partitions (see PQ). 

2.3.2. Trapezoids. 

Definition 5. A (n,k) Magog trapezoid (with k ^ n) is a Magog triangle X — 
i x i,j)n^i^j^i, such that Xij = 1 for i — j > k. 

2.4. Schiitzenberger involution. 

2.4.1. Gelfand-Tsetlin triangles label bases of irreducible representations of 
general linear groups. As such, they are in simple bijection with semi-standard 
Young tableaux. It follows that the Schiitzenberger involution, which is defined on 
SSYTs, can be transported to Gelfand-Tsetlin triangles. The following description 
of this involution has been studied by Berenstein and Kirillov [4]. 

First define operators Sk, for k ^ n — 1, acting on the set of Gelfand-Tsetlin 
triangles of size n. If X = (%i,j)n"^i^j^i is such a triangle the action of Sk on X is 
given by s k X = (5ij)n^i>j>i with 

x k ,j = max(xk+ij,Xk-ij-i) + mia.(xk+i,j+i,Xk-i,j)-Xi ) j 

It is understood that max(a, b) — max(&, a) = a and min(a, b) = min(6, a) = a if the 
entry b of the triangle is not defined. The geometric meaning of the transformation 
of an entry is the following: on row fc, any entry Xkj is surrounded by four (or less 
if it is on the boundary) numbers, increasing from left to right. 
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These four numbers determine a smallest interval containing Xk,j, namely 
[max(xk+ij,x k -xj-i),mia(xk+i,j+i,x k -i,j)] 

and the transformation maps x k ,j to its symmetric with respect to the center of 
this interval. 

Define ujj = SjSj—i . . . S2S1. 

Definition 6. The Schutzenberger involution, acting on Gelfand-Tsetlin triangles 
of size n, is given by the formula 

S = LOiLo 2 ■ ■ -uj„~i 

It is a non trivial result that S is an involution [4|; beware that the s k do not 
satisfy the braid relations. 

2.4.2. One can compute the rightmost diagonal of SX. 

Lemma 1. Let X = (Xij) be a Gelfand-Tsetlin triangle and Y = SX its image 
by the Schutzenberger involution, then 

(2.1) Y nn X nn 

(2.2) Yfe fe = 

max 

n=jo >ji >h ■ ■ ■ >jn-k > 1 

for k < n 

Proof We recall the description of the Schutzenberger involution in terms of 
words and the Robinson-Schensted correspondance. To the Gelfand-Tsetlin triangle 
X let us associate the semi-standard Young tableau, with entries in [1, n], such that 
the shape of the tableau formed with letters u < i is the partition Xij,j = 1 . . . i. 
For example, our Gelfand-Tsetlin triangle 

1 2 2 3 6 
12 2 5 
2 2 4 
2 4 
3 

corresponds to the tableau (in French notation) 

5 

4 5 
3 3 
2 2 5 

1112 4 5 

To such a tableau we associate the word w obtained by reading the tableau from 
top to bottom and from left to right, thus 

w = 545332251 1 1245 

in our example. Then we perform the Schutzenberger involution on the word: we 
read it backwards and replace each letter i by n + 1 — i to give a word Sw, in our 
example 

Sw = 12455514433121. 



E 



x, 



H,3i 



X 



ji+l+i,3i+l 



X 



jn-k+n—k,j n -k 
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Observe that this word is a concatenation of nondecreasing words (Sw)i, (Sw)2, ■ ■ ■ 
corresponding to the successive rows, and that these nondecreasing words, viewed 
as partitions, are the partitions conjugate to the successive SW-NE diagonals of 
the original Gelfand-Tsetlin triangle. 

Applying the Robinson-Schensted algorithm on the word Sw yields an insertion 
tableau which is the image of our tableau by the Schiitzenberger involution. It is 
well known that the longest part of the tableau thus obtained is equal to the longest 
nondecreasing subsequence of the word. Thus the largest element of the top row is 
unchanged. Moreover, the largest element of the i th row (from bottom) is equal to 
the length of the longest nondecreasing subsequence of the subword of Sw made of 
numbers < i. Now X nn — Xj 1 j 1 is the length of the part of the first nondecreasing 
subword (Sw)i of Sw made of letters < n—jx, then Xj 1 +\j 1 — Xj 2 +i lJ ' 2 is the length 
of the part of the second nondecreasing subword (Sw)2 of Sw made of letters in 
[n — ji , n — j'2] , and so on. This yields formula (|2.2[) . □ 

2.4.3. GOG Am triangles. Since the Schiitzenberger involution consists in read- 
ing a word backwards and inverting the letters, we introduce the following definition. 

Definition 7. A GOG Am triangle of size n is a Gelfand-Tsetlin triangle such that 
its image by the Schiitzenberger involution is a Magog triangle of size n. 

Thanks to Lemma Q] we can give a description of GOGAm triangles. 

Proposition 1. X = (Xij) be a Gelfand-Tsetlin triangle then X is a GOGAm 
triangle if and only if X nn < n and, for all 1 < k < n — 1, and all n = jo > j\ > 
32 ■ ■ ■ > jn-k > 1, one has 



Proof. Immediate from Lemma Q] 
2.4.4. GOGAm trapezoids. 

Definition 8. A (n, fc) GOGAm trapezoid is a GOGAm triangle of size n such that 
x i,j = 1 f or i~ 3 ^ k. Equivalently, it is the image by the Schiitzenberger involution 
of a (n, k) Magog trapezoid. 

2.5. A conjecture. We are now in position to state our conjecture on the 
Gog-Magog bijection. 

Conjecture 1. There exists a bijection from Gog triangles of size n to Magog 
triangles of size n, which maps (n, fc) Gog trapezoids to (n, k) Magog trapezoids for 
all k < n. 

A similar conjecture has been made by Krattenthaler [5j. One can refine the 
conjecture by considering statistics on Gog and Magog triangles. Such a study will 
be made in [2], where some further motivation for considering the Schiitzenberger 
involution will be provided. We consider one such statistic in section [3.5.31 below . 

In order to construct such a bijection, it is enough to construct a bijection be- 
tween Gog triangles and GOGAm triangles of the same size. In the next section we 
will give a bijection between (n, 2) Gog trapezoids and (n, 2) GOGAm trapezoids, 
which restricts to a bijection between (n, 1) Gog trapezoids and (n, 1) GOGAm 
trapezoids. 








HAYAT CHEBALLAH AND PHILIPPE BIANE 



3. (n, 2) Gog and Magog trapezoids 
3.1. Inversions. 

Definition 9. An inversion in a Gog triangle is a pair (i,j) such that 

For example the following Gog triangle contains three inversions, (2, 2), (3, 1), 
(4, 1), the respective equalities being in red on this picture. 




Remark 1. The number of inversions of a Gog triangle coincides with the number 
of inversions of its associated ASM, as defined by Mills, Robbins, Rumsey [5]. 

Definition 10. Let X = (^ij)n^i^i^l be a Gog triangle and let (i,j) be such that 
1 ^ i ^ j ^ n. 

An inversion (fc, I) covers (i, j) if i = k + p and j = I + p for 1 $C p $J n — k. 

The entries (i, j) covered by an inversion are depicted with " +" on the following 
picture. 

* * * -L * 

* * _l_ * 
* * 

The basic idea for our bijection is that for any inversion in the Gog triangle 
we should substract 1 to the entries covered by this inversion. This simple minded 
procedure works for (n, 1) trapezoids, as we will show as a byproduct of our bijection 
for (n, 2) trapezoids. It is a good exercise to check this directly. The procedure 
does not work for (n, k) trapezoids with k > 1 but, by making some adequate 
adaptations, we will obtain a bijection for trapezoids of size (n, 2). 

3.2. (n, 2) trapezoids. Consider a (n, 2) Gog trapezoid. This is an array of 
the form 

123 * * n — 2 n — 1 n 

12* * n — 3 &2 ai 

1 * * n — 4 63 02 

1 2 d rl _4 

1 0?i-2 O-n-3 

°n-l a n-2 

a-n-x 

We shall give an algorithm which builds a GOGAm triangle from the Gog tri- 
angle by successively adding NW-SE diagonals of increasing lengths, and making 
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appropriate changes to the triangle. In the end we will obtain a triangle of the form 

111* * 1 Pi (Xq 

11* * 1 fa Oil 

1 * * * /3 3 «2 

1 1 Pn-3 

1 Pn-2 «n-3 

Pn-l O-n-2 

at n -l 

By Proposition [TJ such a triangle is a GOGAm triangle if and only if 

ao < n 

&o — cti + Pi < n — 1 for 1 < i < n — 1 
ao — at + pi - Pj + 1 < j - 1 for 1 < i < j < n - 1 

3.3. The algorithm. First step: the rightmost NW-SE diagonal consists of 
one entry n and is not changed, yielding the triangle of size 1 equal to X^- 1 ' = n. 
Second step: The triangle formed by the two first diagonals is 

71—1 n 
«i 

where a>i — n or n — 1 . In the first case, the algorithm yields the triangle 

n — 1 n 



n 



in the second case we have an inversion and accordingly substract 1 from the upper 
right entry, which gives the triangle 

x (2) _ n - 1 n-1 
n — 1 

Assume now that the first k diagonals have been treated and a triangle X^ 
of size k, of the form 

n — k + 1 n — fc + 1 * n — k + 1 Vi 

n — k + 1 * * V2 

* * * * 

n-k + 1 v k - 2 Ufe-3 

Vk-l "fe-2 
Ufc-1 

has been obtained. Furthermore assume that this triangle satisfies the inequalities 

(3.1) uq < n 

(3.2) uq ~ Ui + Vi < n — 1 for 1 < i < k — 1 

(3.3) uq — Ui + Vi — Vj + 1 < j i — 1 for l<i<j<k — 1 

and that 

(3.4) u k -i = a k -i- 
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Let us add, on the left of this triangle, the diagonal 
n — k 

n — k 



Vk 



with Uk — ctk, Vk — bk- This yields a triangle Z^ k > of size k + 1 (this triangle will 
not, in general, be a Gelfand-Tsetlin triangle, because the inequality Vk < Ufe-i may 
be broken). The algorithm will modify to get a triangle X^ k+1 ^ of size k+ 1, 
of the form 

n — k n — k * * n — k v\ u' n 



< 

We will check that the new triangle is a Gelfand-Tsetlin triangle and that (|3.1I) , 
. . . , (|3.4p are verified for this new triangle. The modification will depend on the 
inversion pattern in the leftmost diagonal that we have added. In all cases, we will 
have 

(3.5) u' k = u k 

the remaining entries being modified as follows, according to the four possibilities 
for the inversions in the two bottom rows. 

(i) The first case is Vk = n — k,Uk = n — k, when there are two inversions. Then 
the modification consists in substracting 1 from each of the entries of the previous 
triangle, that is we put u i = Ui — 1, v[ = — 1, for i < k — 1, and v' k = Vk = n — k. 

(ii) The second is the case Vk = n — k < Uk- Then we put u\ = Ui, v[ = v,- — 1, 
for i < k — 1, and v' k = Vk = n — k. 

(Hi) The third case is when n — k < Vk — Ufe- We put u\ — m — 1 for i < k — 1 . 
Observe that Vk = bk = Uk < dk—i — ttfc-i, therefore Uj, < i < k is nonincreasing. 
Two cases occur: 

(iiia) if the triangle we obtain is a Gelfand-Tsetlin triangle, then we keep 
it as the modified triangle, i.e. we put v\ = Vi for i < k. 

(iiib) if the triangle is not Gelfand-Tsetlin, then there must exist j < k—1 
with Vj = Uj. In this case, we put v[ = Vi — 1, for i < k — 1, and we put v' k — n — k. 

(iv) Finally the last case is when n — k < Vk < Uk- There are two possibilities. 

(iva) if Vk < Vk-i, then Z^ is a Gelfand-Tsetlin triangle, and we do not 
modifiy it, i.e. we put u\ = Ui, v[ = Vi for all i < k, thus X^ k+1 ^ = Z^ k \ 

(ivb) The last case is Vk > i>k-i- First we put u[ = u^ for all i. Let 

(3.6) I = max{i|ufc_i < Vk - i} 
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Since Vk-% is nondecreasing and Vk — i is decreasing, one has I > 1 and Vk-i < Vk — i 
for all i < I. We put v' k — v' k _ 1 = . . . = v' k _ l+1 = n — k and v' k _ l = Vk — I, all the 
other entries being unchanged: v[ — Vi for i < k — I. 

Remark 2. Rules (i), (ii), (iiia), (iva) consist just in substracting 1 from entries 
covered by the inversions in the SE-NW diagonal which has been added. The rules 
(iiib) and (ivb) are more subtle. 

3.3.1. Proof of the algorithm, first part. Let us now check that, in each case, 
we obtain a Gelfand-Tsetlin triangle satisfying inequalities (|3.ip , (|3.2I) . (|3.3p 
(the identity (|3 .4[) is immediate from (|3.5p ). 

We start with rules (i), (ii), (iiia), (iiib), (iva). 

(i) Since au-i = u k -\ > Vk and Vk-i > n — k + 1, X^ k+1 ^ is a Gelfand-Tsetlin 
triangle. For l<i<j<k — 1 one has u' — u' i + v[ — v'j = uq — Ui + Vi — Vj hence 
p.3p is satisfied for these values. Since 

Uq — u'i + v'i ~ v' k — uq — Ui + V{ — 1 — (n — k) < n — I — 1 — (n — k) = k — 2 

we see that (|3.3|) is satisfied for all values. Since u' Q — uo ~ 1 < n ~ 1 and ^ w i 
one has (ET2l) and (|3~T1). 



Again, is clearly a Gelfand-Tsetlin triangle. For 1 < i < j < k we 

check (|3.3|) as above, while (|3.ip is clear, finally u' Q — u' i + v[ = u^ — Ui + Vi — 1 < n — 2, 
and Uq — u' k + v k < n — 1 since — u' k + v' k < —1, which gives (|3.2p . 



(mo) Since > w,;, one has > v[ for i < k, and the triangle is 
Gelfand-Tsetlin triangle. 
One has, successively, 

u' Q = Uq-1 

u' — u'i + v'i = uq — Ui + Vi i < k 
u' Q — u' k + v' k — uq — 1 < n — 1 

u' Q — U i + v'i — Vj — Uq — Ui + Vi — Vj i < j < k 

u' — u^ + v'i — v' k < n — 1 — (n — k) = k — 1 (since v k > n — k) 
from which inequalities (|3.1[) . (|3.2p . p.3p follow. 

(iiib) The new triangle is clearly Gelfand-Tsetlin. Furthermore, one has 

u' Q = U - 1 
u' Q — u'i + v'i — Uq — Ui + Vi — 1 i < k 

u' - u' k + v' k < u' <n 

u' a - it ■ + v[ - v'j — it - u t + Vi - vj i < j < k 

u' - u' t + v[ —v' k = Uo — Ui + Vi — 1 — (n — k) < k — 2 

which imply inequalities (j3.1jl . ()3.2|) . (|3.3| . 



(iva) The fact that X^ fc+1 ^ is Gelfand-Tsetlin is immediate. The inequalities 
are preserved, indeed, all inequalities involving indices < k are immediate, and one 
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has 

u' — u' k + v' k < u' — 1 < n — 1 since u' k > v' k 
Uq — u i + v i — v k < n — 1 — (n — fc + 1) = fc — 2 since u fc > n — k 

3.3.2. Proof of the algorithm, second part. We now consider the last rule, (ivb). 
This is the most delicate part of the proof. We first gather some information on 
the algorithm which has been constructed up to now. 

Lemma 2. Just after a step where rule (i) or (ii) is applied, rule (iiib) never 
applies. 

Proof. Suppose that rule (i) applies to Z^ k \ then n — k = b k = v k = a k = u k , 
and n — k — 1 < b k+ \ = a k+ \ is impossible since this would yield bk+i > a k 
contradicting the Gog strict inequality for the original triangle. If rule (ii) applies 
to then Vi < ui in X^ k+1 \ for all i < k, therefore rule (iiib) cannot be applied 

toz( k+1 \ a 

Lemma 3. If rule (ivb) applies at step k, then necessarily at the previous step 
either rule (iiib) or (ivb) was applied. 

Proof. If one of the other rules had been applied at the previous step, one 
would have Vk-i > Vk- D 

Lemma 4. If rule (ivb) is applied to the triangle Z^ k \ then to each of the triangles 
Z {k-l)^ Z (k-l+l) > ^ Z (k-1) elther rule ( iiib j Qr ( ivb j 

was applied. 

Proof. Assume that at some step t < k in the algorithm we have applied rule 

(iiia) or (iva) to Z^\ then the entry i^* m the triangle X^ t+1 ^ (we emphasize 
the dependence on the step by adding a superscript) satisfies bt — vf +1 \ At each 
next step s, we will substract at most 1 from v[ s \ therefore, in the triangle Z^ k \ 

v ( t k) >b t ~(k-t-l)>b k -(k-t-l)=v { k k) -(k-t-l)> v { k k) + t-k 

It follows that, in Z^ k \ one has I < k —t (where I is defined by (|3.6|) . We con- 
clude that, to each of the triangles Z&~ 1 \ Z( k - l+1 \ Z^ 1 ) either rule (i), (ii), 

(iiib) or (ivb) was applied. But we have seen that rule (iiib) cannot follow imme- 
diately rule (i) or (ii) and that rule (ivb) always follows either rule (iiib) or (ivb), 
so that in fact only rule (iiib) or (ivb) has been applied to each of the triangles 

z(*-o > z( fc - , + 1 ),...,z(*- 1 ). ' ~ □ 

Lemma 5. If rule (ivb) is applied to the triangle Z^ k \ then one has 

Vk-i = • • • = Vk-i = n — k + l. 

Proof. Since n — fc + 1 < Vk-i < •■• < Ufe-i it is enough to prove that v k ^i < 
n — k + 1. By the preceding Lemma, either rule (iiib) or (ivb) has been applied to 
the triangles Z^ k ~ l \ Z {k - l+1 \ Z {k -^ . Let us look at the successive values of 
the entry in the triangle (or Z^). One has v k S/ +1 ^ = n — k + I, since 

rule (iiib) or (ivb) has been applied to Z^ k ~ 1 ^ . Each time rule (iiib) is applied vf\ 
is decreased by 1. There are two cases 

(a) If only rule (iiib) is applied to Z^~ l \ Z (k-i+i) ^ ...^(k-i) then one has 
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(b) If not, let i be the least index I > i > 1 such that rule (ivb) is applied to 
Z^ h ~ % \ and let V = max{j \v^ k k ~^ — j > w^T^.}. By rule one has 



v 



tv-^=^-i-l\ v^^n-k + i, j = 0,1,... I' -1 



Since rule (iiib) is applied to Z^ k . . . , 1 \ one has v^\,_, = bk-i — l' — i- 

and 

(3.7) 4-p = » - fc + !> P = !. 2 > • • • + * ~ 1 

it follows that 

v k-l'-i = b k-i ~ I' ~ * + 1 > h ~ I' ~ i + 1 = 4 fe) - - * + 1 



hence, by ()3.6|) . 

"fc-I'-i > V k - l -* 

therefore I < I' + i, and = n — fe + 1 by (|3.7p . □ 

Lemma 6. If rule (iiib) or (ivb) is applied to the triangle Z^ k \ then there exists 
some i < k — I such that u' i = v[. 

Proof. For rule (iiib) this is easy to see. 

In the case of rule (ivb), there exists some step before k. when rule (iiib) has 
been applied and then only rules (iiib) or (ivb) have been applied. If rule (iiib) 
is applied, there must exist an i with Ui — Vi, and then applying either rule (iiib) 
or (ivb) cannot destroy this pair m = Vi. This implies that there exists some i 
such that u[ = v[. Such a pair cannot exist for i > k — I by the preceding lemma, 
therefore i < k — I. □ 

3.3.3. Proof of the algorithm, end. Assuming that rule (ivb) is applied to the 
triangle Z^ k \ we can now check that our triangle X^ k+1 ^> satisfies all the required 
properties. Since v' k _ l — v k — I, and Vk-i—i > — Z — 1, by the definition of I, 
one has v' k _ l _ 1 > This implies that X^ k+1 ^ is a Gelfand-Tsetlin triangle, as 

is easily verified. 

Let us check the inequalities (|3.1[) . (|3.2|) . (|3.3j) . 

First, since u' = uq, (|3.ip is clear. Consider u' — u\ + v[. Since u\ = Ui is 
unchanged and v[ < Vi for all values of i, except v' k _ { , in order to check (|3.2p it is 
enough to consider u' — u' k _ l + v' k _ t and u' — u' k + v' k . One has 



U 'k-l = U k-l >U k >V k -l = 



therefore 



tk-l+ v k-l <n-l. 



u k , one has 



u' -u' k +v' k <n-l. 

Consider u' — u[ + v[ — v'j, for i < j < k. 

If j < k — Z, then u' — u\ + v[ — v'j = uq — Ui + vi — Vj, so (|3.3p is preserved. 
If j = k — Z, then u! i = u\, v[ — Vi, v'j > Uj therefore the inequality is again true. 
If j > k — I > i, then v'j = n — k = Vk—i — 1 (by Lemma [5]), therefore 

Uq — u ■ + v ■ — v'j =UQ — Ui + Vi — Vk-i + 1 < fe — I — I <j — 2. 
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If j > k — I = i then 

u'q —u'i+v'i — v'j = uo — Uk-i +Vk — l—n + k 

= uq — n + Vk — Uk-i — I + k < k — I — 1 < J — 2 

since v k < u fe _/. 

lfk>j>i>k — I then v- — vL — vi — Vj and u' Q — u[ = uq — it, therefore 
u' - u' l + v[ - v'j = uo —Ui + Vi - Vj < j — 2. 
Finally if k = j > i > k — I, then 

u' — v! i + v[ — v' k = uq — m + Vi — 1 — (n — k) < n — 1 — 1 — (n — k) = k — 2. □ 

Applying the algorithm until we have treated all diagonals, we obtain thus a 
(n, 2) GOGAm trapezoid from our (n, 2) Gog trapezoid. 

3.3.4. Invertibility. We can infer from the leftmost SE-NW diagonal of X^ k+ ^ 
which rule was applied to Z^ k \ The only ambiguity is whether rule (ii), (iiib) or 
(ivb) has been applied when n — k — v' k < u' k . Rule (ii) has been applied if and 
only if one has u[ > v[ for alH < k. In order to distinguish between rules (iiib) and 
(ivb) we now state the following lemma. 

Lemma 7. Assume X^- k+1 ' ) is obtained from by applying rule (iiib) or (ivb), 
and let I = 1 + max{i|ul - = n — k}, then 

(&) v 'k-i + ^ < u 'k if ru ^ e (^ v b) has been applied. 

(b) v' k _i + I > u' k if rule (iiib) has been applied. 

Proof. Part (a) is obvious from the statement of rule (ivb), since v' k _i + I = 
v k <u k = u' k . 

In order to prove part (b), note that in case (iiib) is applied to Z^ k \ then by 
Lemma 2, to all the triangles Z^ k ~^ for 1 < i < I — 1 either rule (iiib) or (ivb) has 
been applied. If only rule (iiib) has been applied to Z^ k ~ l+1 \ . . . , Z^ 1 * 1 , then rule 
(iiia) or (iva) must have been applied to Z( k ~ l \ therefore, v' k _ l = b k -i — I which 
implies v' k _ l + 1 = b k -i > b k = a k = u' k . 

If rule (ivb) has been applied at some step t with k — l + 1 < t < k—1, then let 
i be the smallest number such that (ivb) has been applied to Z^ k ~ l \ By Lemma[5] 
there exists an I' > 1 such that 

v k-i = ■■■Vk-i-l'U =»-« + *-! 

and 

tfclt' 1 ' = &k-< -i'>n-fc + i- l. 
Since rule (iiib) is applied to Z^ k ^ l+1 \ . . . , Z^ 1 ^ it follows that 

v' k = ... = Vfc-i-r-i = n-k 

and 

therefore I = V + i and + Z > u' fc since + I = b k -i > b k = a k = u' k . 

□ 

3.4. The inverse map. 
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3.4.1. The algorithm. We now prove that the map defined above has an inverse. 
Let X be a (n, 2) GOGAm trapezoid of shape 

1 1 1 * * 1 /3\ a 

1 1 * * 1 $2 Oil 

1 * * * /?3 Oil 

1 1 Pn-3 

1 Pn-2 Oin-3 

Pn-1 Ctn-2 

One has 

a < n 

o;o — CKj + Pi < n — 1 for 1 < i < n — 1 

ao - on + Pi — pj + 1 < j - 1 for 1 < i < j < n. - 1 

We shall give an algorithm which is the inverse of the one above. 

Let k be an integer decreasing from k = n — ltofc = 0. Let Y^ n ' be an empty 
set, and = X; at each step we will have a pair (yC=+i) ; l('+i)) where y(fc+i) 
is an array (non empty only for k < n — 1) 

1 2 * n-k-1 

1 2 * * 

* * * n — k — 1 

* * * bk+i 

1 &n-2 * 

On-1 01n-2 

which forms the leftmost NW-SE diagonals of a Gog triangle, and X^ k+lS> is a 
Gelfand-Tsetlin triangle: 

n — k n — k * n — k v[ u' 

n — k n — k * v' 2 u'i 

* * * * 

n - k V 'k-1 U 'k-2 

V 'k U 'k-1 

satisfying the inequalities (|3.1[) , (|3.2p , (|3.3p . Then we make a modification of the 
triangle X^ k+1 \ according to the rules below, to get a triangle Z^ k ' 

n — k n — fc + 1 * n — k + I vi uq 

n — k n — fc + 1 * V2 Ui 

* * * * 

n — k vk~i uk-2 

Vk U k -l 
Uk 
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Then we add the leftmost NW-SE diagonal of this triangle to the right of Y^ k+1 ' 
to get (thus bk — Vk and ak = Uk), and take the remaining triangle as X^ k \ 
We will prove that, at each step, X^ is a Gelfand-Tsetlin triangle which satisfies 
the inequalities p.ip , (|3.2I) . (|3.3p . Also we will prove that, at the next step of the 
algorithm the entries a,k-i,bk-i satisfy 

(3.8) n - k + 1 < b k -i, bk < bk-i, b k < ak-i, b k < ak < a k -i < n 

which imply that the triangle Y^ ' is a Gog triangle. 

We will use the following notation: if v' k = n — k and there exists i < k such 
that u\ = v'i, then 

(3.9) 1 = 1 + maxOX^ = n- k}. 

Let us now describe the modification map yilding triangle from x( k+1 ^ by 
the inverse algorithm, for which we consider several cases, inverse to the cases 
considered in the direct algorithm. 

(i) n — k = v' k = u' k , then we put Ui = u\ + 1, i?j = v[ + 1 for i < k — 1 and 
v k = v' k ,u k = u' k . 

(ii) The second case is n— k = v' k < u' k , and v[ < v! i for all i < k. Then we put 
Ui = uhvi = v[ + 1, for i < k — 1, and t> fe = v' k ,u k = u' k . 

(iiia) n — k < v' k = u k , then we put Ui = u\ + 1, Vi = v[ for i < k — 1, 
and w/c = u fc = uj.. 

(iw6) n — k = v' k < u' k , there exists i < k such that u[ = v[, and 
v 'k-i + ' — u 'k ( reca ll (|3.9p ). then we put Ui = + 1, Vi =v' i + l, for i < k — 1, and 

(wa) n — k < v' k < u' kl then we put Ui — u[,Vi = v' i: i < k. 

(ivb) n — k = v' k < u' k , there exists i < k such that u\ = v[, and 
v 'k-i + ' ^ u /c' then we put = u^, for i < k, = n — k + 1 for k — I < i < k — 1, 
Vk — v 'k-i + ^ an£ l w i = u i f° r & H other i. 

Let us now check that this map is well defined. By section (|3.3.4j) . it is an 
inverse of our modification map. We consider successively the cases (i),. . . ,(iv) 
above. First, by checking all cases successively, one sees that the sequence <Zj 
constructed by the rules above is nonincreasing (a^ < aj_i), and that bi > n — i. 
The remaining inequalities in (|3.8p will be checked case by case. We also have to 
check that the triangles X^ k ' are Gelfand-Tsetlin, and that they satisfy (|3.1[) . (|3.2p . 
p.3p . The equality (|3.4p is immediate by inspection. We start with an observation 
about rules (iiib) and (ivb). 

Lemma 8. If rule (iiib) or (ivb) has been applied to the triangle X^ k+1 ^ then in 
the triangle there exists a pair Ui = U,-. 

Proof. This is immediate for rule (iiib), since adding 1 to both u\ and v[ does 
not destroy the equality u[ = v[. 

For rule (ivb) we notice that n — k — v' k < u' k , and v' k _ l + 1 < u' k < u' k _ l imply 
that < u 'k-j f° r 3 = 1 ■ • ■ h therefore the inequality u[ = v\ must be realized 
for some i < k — I, and then = u[ = v[ — Vi by rule (ivb). □ 
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3.4.2. Proof of the algorithm. We now check successively all rules of the inverse 
algorithm. 

(?) It is clear that the triangle X^ is Gelfand-Tsetlin. 
We have u' Q = u' Q — u' k + v' k < n — 1, this proves (|3.1D . 

Since UQ — l—Ui+Vi~(n—k) = u' — u^+v^— v k < k— 2 we have u$— iii+Vi < n—1. 
All other inequalities in (|3.2p . (|3.3| involve differences like wo — iti or Vi — Vj 
which are not unchanged by the replacement v! — > u, v' — > v. 
Also inequalities (|3.8p are immediate. 

(ii) Since v\ < for all i one has vi < u t , hence X^ is a Gelfand-Tsetlin 
triangle, and (|3.ip is immediate since u = u' . 

Since u' — u[ + v[ — v' k < k — 2 one has uq — Ui + Vi < n — 1, thus (|3.2|) . holds. 
Finally (13. 3p comes from Uq — = uq — Ui v[ — v'j — Vi — . 
The inequalities (|3.8p at the next step are immediate. 

{Hid) Again it is easy to see that X^ is a Gelfand-Tsetlin triangle. Since 

u 'o ~ u 'k + v 'k — n ~ 1 an< ^ u fc = v 'k we § e ^ M o = u 'o + 1 < n -, hence (|3.ip . 
The other inequalities p. 21) . (|3.3p are checked similarly. 
The inequalities (|3.8p at the next step are immediate. 

(iiib) The fact that X^ is a Gelfand-Tsetlin triangle is immediate. 
Since there exists j with u'j = v'j one has u' — u' Q — u'j + v'j < n — 1 thus 
uo = u' Q + 1 < n. 

Since u' — u\ + v\ — v' k < k — 2, it follows that u'q — u'i + v[ < n — 2 and 
uo — Mi + Vi < n — 1. 

The other inequalities are satisfied since u' — u\ + v[ — v'j — uq — Ui + vi — Vj 
for 1 < i < j < k — 1. 

We now check the inequalities (|3.8p . 

One has = au < afe-i = u' k _ 1 + 1. 

It remains to see that bk < 

If fj.— l > n — fc, then i^-i = Wj.-i + 1 > ^fe = <Zfe = frfe since we are applying 
rule (iiib) to x( fe+1 ) (in this case, 1 = 1). At the next step, we will have bk-i > 

If v' k _ 1 = n — fc, then one has I > 1, and by Lemma [5] either rule (iiib) or rule 
(ivb) applies to X^ k \ In either case it is easy to see that bk < fefc-i- 

(iva) In this case, the fact that X^ is a Gelfand-Tsetlin, as well as the inequal- 
ities (|3.ip . (|3.2p . (|3.3p . is immediate. Also the inequalities (|3.8p are immediate. 

Since n — k < u' k < u^ for i < fc — 1 it follows that Ui > n — fc + 1 for all 
i. It is then clear that X^ is a Gelfand-Tsetlin triangle. 
Let us check the inequalities flX]]), <EH)> <&M for X^. 
Since «o = u' Q inequality (13. ip is obvious. 

One has uq — Ui + Vi = u' a — u[ + v[ < n — 1 for i < k — I. For k > i > k — I one 
has «i = n — fc + 1 < Vk-i + I < Uk _ Ui therefore —iii+Vi < —1 and inequality 
([3~2]) holds. 

Inequality iio — — + 1 = u' Q — u^+v^ — Vj + 1 < j — 1 holds if i < j < fc — 
If i < fe — i, one has 

Uq — Ui + Vi — (n — k) + 1 = u' - u'i + v'i — Vfe_2 + i + 1 < fc - / 
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hence 

uo — Ui + t'i — Vk-i + l=ito— Ui + Vi — (n — k + l) + l<k — I — 1 

which proves Q3.3[) for i < j = k — I. 

If i < k — I < j then Vi = v[ and Vj > v'j therefore the (|3.3[) also holds. 
One has 

it - Uk-i + Wfc-i - Vj + 1 < u' - u' k _ t + v' k _ l -Vj + l<k-l-l 

proving ()3.3j) for i = k — I < j . 

If fc — I < i < j, then Vi — Vj, and v[ = therefore 

w - Ui + Vi — Vj + 1 = u' — it- + v[ — v'j + 1 < j — 1, 
It remain to check inequalities (|3.8p . 

After rule (ivb) is applied one has Vk-i = n — k + 1 and, for some i < k — 1, 
Ui = Vi therefore rule (iiib) or (ivb) applies to the next step. In either case one has 

bk < a/fe-i. 

Recall that 

b k = v' k _i +1 <u' k =a k 

and 

v k ^i = ... v k -i =n — k + l. 

It follows that I' = 1 + max{i|?;fe_i_i = n — k + 1} > Z. 

If f fc-i-z' + /' < u k -\ then rule applies to X^^ 1 ' and 

&fc-i = Vk-i-i' + 1' > v' k _[ +1 = b k . 

If ffc-i-/' + V > Ufc_i then Z = = ttfc_i and 

bk-l = Ufc-l-i' + i' = ua-i-j + ^ = "fe-l > fefe- 

□ 

3.5. Some properties of the bijection. 

3.5.1. (n, 1) trapezoids. If one starts from a (n, 1) trapezoid, then only rules (i) 
and (m) apply, and it is easy to see that one gets in the end a (n, 1) GOGAm trape- 
zoid, and that it is obtained by substracting from any entry of the Gog trapezoid 
the number of inversions which cover it. The same remark applies to the inverse 
map, so that our bijection restricts to a bijection between (n, 1) trapezoids. 

3.5.2. (n, 2, k) trapezoids. A (n, 2, k) Gog trapezoid is a (n, 2) Gog trapezoid 
such that Xjj = n for j > k, and Xjj—i = iaax.(X ktk —i,j — 1) for j > k. 

A (n, 2, k) Magog trapezoid is a (n, 2) Magog trapezoid such that Xij = 1 for 
3<k. 

Our bijection restricts to a bijection between (n, 2, k) Gog trapezoids and 
(n, 2, k) Magog trapezoids for all k < n. 

3.5.3. A statistic. For a Gog triangle X the entry An gives the position of the 
1 in the bottom row of the associated alternating sign matrix. If A is a (n, 2) Gog 
triangle, it follows from our algorithm that the 11 entry of the GOGAm triangle 
has the same value An. From Lemma U we conclude that for the (n, 2) Magog 
triangle T, associated to A, one has An = 53i=i -^>« — ^i,n-i- it is known 
that, more generally, these two statistics on Gog and Magog triangles coincide (see 
e.g. SI). 
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